Meta Faces Government Scrutiny Over Algorithms Boosting Misleading Content

The government has warned that recommendation systems that disproportionately promote certain types of content could create confusion, fear and problems related to public order.

The ministry has expressed concern that videos, photographs and graphics relating to public incidents, law-and-order situations and sensitive circumstances sometimes reach large numbers of people without sufficient context. If algorithms repeatedly amplify such material, it could spread confusion and apprehension among the public.

In its advisory, MeitY emphasised the need for additional vigilance during incidents involving public order and law and order. The ministry specifically flagged concerns over old photographs and videos being presented as footage of new incidents, edited visuals, unverified claims about emergency restrictions or police action, and audio-visual content circulated without adequate context.

The government believes that the rapid spread of such material could have consequences in the real world, particularly when misleading information reaches a large audience.

MeitY has also asked Meta to develop robust mechanisms to identify posts and other content receiving unusually high reach through algorithmic recommendations. The ministry wants such material to be reviewed in a timely manner and escalated to higher levels whenever necessary, particularly when it poses a risk of widespread confusion, violence or disruption of public peace.

The advisory comes amid a broader debate over the responsibilities of social media platforms. The discussion is no longer limited to what content is available on these platforms, but also extends to which content is distributed to millions of users and why it receives such visibility.

Issued under the Information Technology Act, 2000, and the IT Rules, 2021, the advisory asks Meta to ensure that misleading, manipulated or out-of-context material is not disproportionately promoted. It has also called for adequate context to accompany photographs and videos relating to public incidents so that users can better understand their dates, locations and actual circumstances.

However, the government has clarified that its objective is not to restrict legitimate expression or public discussion. MeitY has asked Meta to strengthen its existing safety and content moderation mechanisms while ensuring that these measures do not impose unnecessary restrictions on lawful and democratic dialogue.

The advisory states that the measures are intended to promote responsible dissemination of information while preserving respect for freedom of legitimate expression.

MeitY has directed Meta to take the necessary steps with immediate effect and inform the ministry about its compliance. However, the advisory does not identify any specific post, incident or piece of content, nor does it detail the changes Meta will make to its algorithmic systems.

The directive places the spotlight on the role of recommendation algorithms in shaping the information users encounter, signalling that the government's concerns extend beyond content moderation to the mechanisms that determine how widely information spreads across social media platforms.